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Estimation of the Variance of a Stationary 
Gaussian Random Process by Periodic Sampling 

By J. C. DALE 

(Manuscript received February 14, 1967) 

I. INTRODUCTION 

This paper* applies previous work 1 on estimation of the mean of a 
stationary random process by periodic sampling to estimation of the 
variance with the added restriction that the process under considera- 
tion be Gaussian with known mean. 

The samples are taken from a sample function of the random proc- 
ess, in a closed interval (0, T) and are in general correlated. The esti- 
mator used is the average of equally-weighted squared samples. The 
variance of this estimator is derived and its behavior is predicted as a 
function of the number of samples and length of record. 

II. THEORY 

2.1 General 

Let x(t) be a sample function from a stationary, Gaussian random 
process {x(t)} with known mean.' 

An unbiased estimator of the variance is given by 

*--itfi£*vm/' (1) 

where T/N is the sampling period. 

By invoking the Gaussian assumption, the variance of this estimator 
follows directly and is given by 



* This work was supported by the U.S. Navy, Bureau of Ships under Contract 
N00 600-67-CO549. 

t So long as the mean of {x(t)} is assumed known, no generality of the deriva- 
tion is lost by letting it be zero. 
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or in an equivalent form (2) 

var (&l) = j^j /_" q ( , + 1/N) r(r)Rl(r) £_ *(r - ~) dr. 

qw + i/N)T(r) is the triangular weighting function (See Ref. 1) and R x (t) 
is the autocorrelation function of {£(£)}. 

By comparing the var (& 2 X ) to (3) in the previous paper 1 it is seen 
that (2) gives the variance of the sample mean of a stationary random 
process {x 2 (t)\, whose autocovariance function is given by 2R\ (t). 
The spectrum of {x 2 (t)\ is 2S x (u>) * £,(«). 

At this point the previous theory 1 applies directly. Using the same 
notation, the spectrum of the squared samples can be written as 

2 f™ r / kT\ 

(?(«) = jj-£^ J ^ q iN+1/ ^r(r)R 2 z (T)e- iaT J£ 5^r - ^j dr, 

which is equivalent to (3) 

In this case 

F(») = Q(«) * 2[&(«) * 5»], (4) 

and Q(o>) is the transform of the weighting function. 

G(«) can be interpreted as F(»), shifted by integral multiples of the 
sampling frequency, 2-n-N/T. As before to obtain the variance of the 
estimate we need only be concerned with the value of G (w) at w — 0. 
To minimize the variance of the estimate, the sampling frequency 
should be high enough to prevent overlapping of the sideband at w = 0. 
Satisfying this condition results in 

vwG# = f F(0).t (5) 

To answer the question of how many samples to take in time T to 
obtain minimum variance, consider (4). Q(«) is approximately zero for 

t Equation (5) is not quite true when both end points of the time record are in- 
cluded as samples. This is because (N /T) F(0) is a function of N namely, 

1 -— fsin y(N + 1/2N)TJ 

(N/T) F(0) - - £ W „) * &(,)][ - + i/W)r J * 

Increasing iV beyond the value given in (8) actually results in a higher variance on 
the estimate. This is apparent in the two examples, particularly for T small. This 
same effect was discussed in Ref. 1. 
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M ^ (2t/T)[N/(N + 1)]. If SM is zero for |<*| ^ 2x5, then 
$,(«) * £ x (w) will be zero for |«| ^ 4ttB and ^(co) will be approximately 
Ofor 



> 27 



2B + 



rw + ij 



Therefore, choosing the sampling frequency so that 






2B + ^ 



.V 



r w + 1/_ 



(6) 



(7) 



results in (5) being satisfied. 

Solving (7) for N yields the required number of samples taken in 
time T to approximately minimize the variance of the estimate, namely 



N = 2BT 



v- 



+ vi + 2/gjH 



2 



J" 



(8) 



For BT » 1, N is approximately equal to 2BT. Thus, twice the num- 
ber of samples are required to obtain a minimum variance estimate 
of the variance than was previously shown to obtain a minimum vari- 
ance estimate of the mean. 



2.2 Variance For Large T 

If T is allowed to become large Q (w) will approach a delta function, 

2tt 



limit (?(•)= j, _ r , 



«(«). 



This results in 



F(fa) = t(at + i) /_" ^ s > - ») «&■ 



(9) 



(10) 



If Sfl,(a>) is zero for | o> | S 2tt/?, and the sampling frequency satisfies 
(7), then the minimum value of variance of the estimate is given by 



N 



This is the same value obtained by continuous sampling. 



I f S 2 z (y) dy, (11) 

7T J_ m 
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III. EXAMPLES 

The variance of the estimate of variance as a function of number of 
samples (JV+1) and length of record {T) has been computed for two 
examples. 

The computation was done using an expression equivalent to (2). 

3.1 Rectangular Spectrum 



sm = 



-2tt < co < 2ir, 
elsewhere. 



(12) 



Fig. 1 shows var (& 2 X ) plotted against number of samples. Each curve 
represents a different length of record as indicated by the values shown 
on the figure. It should be noted that the minimum value of var (&l) 
occurs at the number of samples predicted by (8). Also for small values 
of T the var (& 2 X ) reaches a minimum and then increases as more samples 
are taken. This is due to including both end points of the time record 
as samples. 
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Fig. 1 — Variance of the sample variance as a function of the number of sam- 
ples and length of record for a process with rectangular spectral density. 
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Via. 2 — Variance of the sample variance as a function of the number of sam- 
ples and length of record for a process with Markoff spectral density. 



3.2 Markoff Spectrum 



8M = - 



(13) 



w- + 1 

This sample shows a nonbandlimited spectrum. The results are shown 
in Fig. 2. 



IV. CONCLUSION 

By making the assumption that the random process \x(t)} was 
Gaussian, it was possible to express var {&]) into an array of terms 
containing R;(kT/N), (2). In this form it is possible to apply the theory 
developed in the work on estimation of the mean. 1 The interesting result 
from this derivation was that when BT 2> 1, the variance of the sample 
variance is essentially minimized when 2BT samples are taken. This 
is in contrast to the BT samples required to minimize the variance of 
sample mean. 
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A Floating Gate and Its Application 
to Memory Devices 

By D. KAHNG and S. M. SZE 

(Manuscript received May 16, 1967) 

A structure has been proposed and fabricated in which semi- 
permanent charge storage is possible. A floating gate is placed a small 
distance from an electron source. When an appropriately high field 
is applied through an outer gate, the floating gate charges up. The 
charges are stored even after the removal of the charging field due 
to much lower back transport probability. Stored-charge density of 
the order of 10 12 /cm 2 has been achieved and detected by a structure 
similar to an metal-insulator-semiconductor (MIS) field effect transis- 
tor. Such a device functions as a bistable memory with nondestructive 
read-out features. The memory holding time observed was longer than 
one hour. These preliminary results are in fair agreement with a simple 
analysis. 

It has been recognized for some time that a field-effect device, such 
as that described by Shockley and Pearson, 1 can be made bistable 
utilizing switchable permanent displacement charges on ferroelectric 
material. 2 Subsequent studies of ferroelectric material have revealed, 3 
however, that the inherent speed capability of a device incorporating 
a ferroelectric material is limited by domain motion, whose highest 
speed is limited by the acoustic velocity. In the absence of highly 
ordered, near-ideal thin film ferroelectric material, the speed capability 
of a bistable device, therefore, is in the microsecond range at best. 4 In 
addition, many ferroelectric materials suffer from irreversible mechani- 
cal disorder after many cycles of polarization switching, 2 rendering 
some uncertainty on the long term device reliability aspect. 

An alternative to a ferroelectric gate is a floating gate chargeable by 
field emission, which hopefully circumvents the above mentioned diffi- 
culties. Consider a sandwich structure, metal M(l), insulator 1(1), 
metal M(2), insulator 7(2), and finally metal M(3). (See Fig. 1). If 
the thickness of 7(1) is small enough so that a field-controlled electron 
transport mechanism such as tunneling or internal tunnel-hopping 
are possible, a positive bias on M(3) with respect to M (1) with Af (2) 
floating [M(2) is called the floating gate henceforth], would cause 
electron accumulation in the floating gate, provided electron transport 
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Fig. 1 — Energy band diagram of a floating gate structure with a semiconductor- 
insulator-metal-insulator-metal sandwich. For calculation of the stored charge, the 
semiconductor is replaced by a metal il/(l). (a) When a positive voltage step is 
applied to the outer gate, (b) When the voltage is removed. The stored charge 
Q causes an inversion of the semiconductor surface. 



across 7(2) is small. These conditions can be met by choosing 7(1) 
and 7(2) such that the ratio of dielectric permittivity ci/e 2 is small 
and/or the barrier height into 7(1) is smaller than that into 7(2). The 
sandwich structure is somewhat similar to the tunnel emitter metal- 
base transistor proposed by Mead 5 in its structure but with the follow- 
ing essential differences. 



(i) 



(in) 



M(2) is much thicker than the hot electron range, so that 

emitted electrons are close to the Fermi-level of Af(2) before 

reaching 7(2). 

No carrier transport is allowed across 7(2). 

M(2) is floating. 
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The stored charge Q, as a function of time when a step voltage func- 
tion with amplitude V is applied across the sandwich, is given by 

Q(t) = [ jdt' coul/cm 2 . 0) 

When the emission is of Fowler-Nordheim tunneling type, then the 
current density, j, has the form 

j = C\E 2 exp(-E n /E), (2a) 

where Ci and E are constants in terms of effective mass and the barrier 
height. (We have neglected the effects due to the image force lowering 1- ' 
of the barrier, etc., but the essential feature is expected to be retained 
even after detailed corrections are made) . This type of current trans- 
port occurs in Si0 2 and A1 2 3 . 

When the field emission is of the internal Schottky or Frankel-Poole 
type, as occurs in SisN.*, 7 then ;' follows the form 

j = C 2 E exp [-(?(*, - VqE/mJ/kT], (2b) 

where c-, is a constant in terms of trapping density in the insulator, *i 
the barrier height in volts, €1 the dynamic permittivity. 

The electric field in 7(1) at all times is a function of the applied 
voltage V and Q(t), and is obtainable from the displacement continuity 

requirement as 

F - V - Q (3) 

r/, + d 2 ( €l /e 2 ) 6, + e 2 (d x /d 2 ) ' 

where <k and d 2 are the thickness of 7(1) and 7(2), respectively. 

Fig. 2(a) shows the results of a theoretical computation using (1), 
(2a), and (3) with the following parameters: d x = 50 A, ei = 3.8 c (for 
Si0 2 ) , d 2 = 1000 A, c 2 = 30 e (for Zr0 2 ) , and V = 50 volts. One notes 
that the stored charge initially increases linearly with time and then 
saturates. The current is almost constant for a short time and then 
decreases rapidly. The field in 7(1) decreases slightly as the time 
increases. The above results can be explained as follows: When a 
voltage pulse is applied at t = 0, the initial charge Q is zero, and the 
initial electric field across 7(1) has its maximum value, E max = 
V/[di + (e i /€o)d- 2 ]. As t increases, Q will first increase linearly with 
time. This is because of the fact that for small Q such that E remains 
essentially the same, the current will in turn remain the same, so 
Q = j(E mas ) ■ t. Eventually, when Q is large enough to reduce the 
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Fig. 2(a) — Theoretical results of the stored-charge density (Q), the current 
density U), and the electric field across Hi) as a function of time. V = 50 volts, 
(I, = 50 A, e./e = 3.8 (for SiOs), d, = 1000 A, e ../ e „ = 30 (for ZrOa). (b) The- 
oretical results of the stored charge density as a function of time with 
the same ei and e a as in (a), and il t = 10 A, dt = 100 A (solid lines), 
ih = 30 A. d 2 = 300 A (dotted lines), (c) Theoretical results of the stored density 
as a function of time with </i = 20 A, c/eo = 60 (for Si»N«), rf= = 200 A, 
e 3 /e = 30 (for ZrOa) and various applied voltages. 

value of E substantially, then the current will decrease rapidly with 
time and Q increases slowly. 

Fig. 2(h) shows the stored charge as a function of time for the time 
ei and co but different d lt cL, and V. It is clear that for a given structure, 
in order to store a given amount of charge, one can either increase 
the applied voltage or increase the charging time (pulse width) or both. 
Fig. 2(c) shows the calculated stored charge for the current transport 
described by (2b). Here 7(1) is a 20 A thick Si 3 N 4 film. There are 
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marked decreases in the gate voltages required for a given charge 
compared to A1 2 3 , Si0 2 . This is largely due to the much lower barrier 
height (1.3 volts) 7 compared to Si0 2 (~ 4.0 volts) . 8 

It is noted that the field in 7(1) for appreciable charge storage is in 
the 10 7 V/cm range. When the outer gate voltage is removed, the field 
in 7(1) due to the stored charge on the inner gate is only 10 6 V/cm 
or so corresponding to 5x10" charges/cm 2 , a large enough charge to 
detect easily. Since the transport across 7(1) is highly sensitive to the 
field, (2a) and (2b) , no charges flow back. The charge loss is actually 
controlled by the dielectric relaxation time of the sandwich structure, 9 
which is very long. When it is desired to discharge the floating gate 
quickly, it is necessary to apply to the outer gate a voltage about equal 
in magnitude but opposite in polarity to the voltage which was used 
for charging. It is evident that net positive charges (loss of electrons) 
can also be stored in the floating gate if the discharging gate voltages 
are appropriately chosen in magnitude and duration. 

It was mentioned that the stored-charge density of 5xl0 12 /cm 2 
was sufficient for easy detection. One of the detection or read-out 
schemes is to use the surface field effect transistor (MOSFET or 
IGFET) first fabricated and described by Kahng and Atalla 10 in 1960. 
For inversion at a silicon surface, the charge required is only about 
2xlO u /cm 2 for 1 ohm-cm n-type silicon. However, surface-state 
charges at the silicon-silicon dioxide interface may be as high as 
10 12 /cm 2 , depending on the fabrication techniques used. For this reason 
we have chosen 5xl0 12 /cm 2 as the stored charge required for easy 
detection. When the Insulated Gate Field Effect Transistor (IGFET) 
principle is used for read-out, M(l) is now replaced by silicon. This 
requires a slight correction in the calculation of charge flow through 
the insulator, but the major features of the results are not expected to 
be altered significantly. It is to be noted that about one half of the 
stored charge can be active in creation of the inversion layer since 
the other half resides near the M (2) -J (2) interface due to Colombic 
repulsion. 

To check the feasibility, a floating gate device has been fabricated 
using an IGFET as shown in Fig. 3(a). The substrate is an n-type 
silicon, 1 ohm-cm, and (111) oriented. 7(1) is a 50 A Si0 2 thermally 
grown in a dry oxygen furnace. M (2) and 7(2) are Zr (1000 A) and 
Zr0 2 (1000 A), respectively. J17(3) and the ohmic contact metals are 
aluminum deposited in a vacuum system. Fig. 3(b) is another version 
of the floating gate device using a thin film transistor (TFT) struc- 
ture. 11 
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Fig. 3 — (a) Schematic diagram of a floating gate device using an IGFET. The 
numbers indicated correspond to those shown in Fig. 1. (b) Schematic diagram 
of a floating gate device using thin film transistor structure. 

The IGFET-type floating gate devices have been tested in a pulsing 
circuit. Because of the relatively thick insulator layers, large voltages 
(S 50 V) and long pulse width (zz 0.5 /xs) have to be applied in order 
to store ^ 5 X 10 12 charges/cm 2 . Fig. 4 shows the experimental results. 
A positive pulse of 50 volts is first applied to the gate electrode, and 
60 ms later a negative pulse of 50 volts is applied. Then the pulsing 
cycle repeats. In Fig. 4(a) the pulse widths are 0.5 p.s. One notes that 
when the positive pulse is applied, a sufficient amount of charge is 
stored in the floating gate so that the silicon surface is inverted; a 
conducting channel is thus formed, and the channel current is "on." It 
can be seen that the channel current decreases only slightly at the end 
of 60 ms. When the negative pulse is applied, the stored charge is 
eliminated, and also the channel. The channel current reduces to its 




Fig. 4 — Experimental results of the channel current of a IGFET-type floating 
gate device. A positive voltage pulse, V,, with pulse width II',, is first applied to 
the gate, and 60 ms later a negative pulse V« with pulse width W s is applied. Then 
the pulsing cvcle repeats. Horizontal s^-ale : 20 ms/div. Vertical scale : 0.1 ma/div. 
(a) W = V,'= 50 volts, JPi = W, = 0.5 pB. (b) 7i = V, s 40 volts, Wi = W, = 
0.5 ms. 
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"off" state. Fig. 4(b) shows results for pulses with the same widths 
but smaller amplitude (40 V). Since the stored charge is a strong 
function of the pulse amplitude, only a very small amount of charge is 
stored, too small to cause inversion. For non-leaky units, the memory 
holding time of longer than one hour has been observed. 

It is clear that a modified IGFET such as a TFT can be used for 
read-out, as shown in Fig. 3(b). For an academic study of device opera- 
tion, the floating gate can be partially exposed and a potential probe 
can be placed nearby. 

In conclusion, it has been demonstrated that the controlled field 
emission to the buried "floating" gate may be capacitively induced by 
pulsing the outer gate electrode. This combination can therefore, be 
used as a memory device, with holding time as long as the dielectric 
relaxation time of the gate structure and with continuous nondestruc- 
tive read-out capability. There seems to be no inherent reason why 
read-in read-out cannot be performed in a very short time, say in the 
nanosecond range or even shorter. 

We wish to acknowledge helpful discussions and technical assistance 
rendered by M. P. Lepselter and P. A. Byrnes in connection with Zr0 2 , 
and skillful technical assistance given to us by G. P. Carey and 
A. Loya, and J. F. Grandner and his group. 
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Semipermanent Memory Using Capacitor Charge 
Storage and IGFET Read-out 

By D. KAHNG 

(Manuscript received May 17, 1967) 

One of the earliest computers used capacitors as its memory. 1 A 
mechanical means was used for both read-in and read-out operations. 
Electronic accessing was used in conjunction with vacuum tube or 
solid-state diodes in relatively modern computers such as the SEAC 
computer. 2 Capacitor storage is rarely used at present since magnetic 
memories meet the modern computer requirements much better. The 
inherent difficulty with capacitor storage was the limited holding time 
since a nonlinear resistor with small enough leakage currents to allow 
useful memory holding time was then not readily available. The old 
capacitor memory was charged through a diode with slow recovery 
time and with leakage current of 10" 10 amp at best and required a 
large capacitor for any appreciable holding time. Furthermore, the 
read-out was usually destructive. 

The capacitor storage merits re-examination in view of the advanced 
solid-state devices and technology now available. Coupled with an 
Insulated Gate Field Effect Transistor (IGFET), 8 the read-out can 
be nondestructive. Integrated circuit techniques may prove superior 
to the current magnetic memories for some applications where in- 
frequent recycling is permissible. The inherent speed should be much 
faster than that of magnetic units. 

Consider a capacitor C in series with a nonlinear element as shown 
in Fig. 1. The capacitor may represent the gate capacity of the IGFET 
plus any external capacitor in parallel with the gate capacitor. When a 
positive voltage pulse with amplitude V and duration r is applied at 
the nonlinear element terminal, it can be shown that the stored charge 
Q(t) and the decay time constant r e , denned as the time required to 
reach 1/e value of the initial stored charge Q , can be calculated for 
various nonlinear resistors. 

I. POWER-LAW RESISTORS 

The I-V characteristics are given by 

I = KV:, (1) 

1296 



B.S.T.J. BRIEFS 1297 

then 

Q(r) = C\V - (yr^ry 4- K(m - 1) ^)" ] (2) 

and 

C m 1 ,,«-„ 



•'- (m-\)KQlr- l){em { l) (3) 

= (e"-" - 1) Q 
(m - 1) /,, ' 

where I is the discharge current at the termination of charging. It is 
clear from (2) that m ^ 1 for physically meaningful Q(t). For a long 
holding time, (3) tells us that the nonlinearity of the resistor should 
be large. These equations would describe the behavior of the storage 
unit comprising a space-charge-limited-current diode. 4 If traps are 
present, only a simple modification is needed in the analysis. Structures 
comprising photosensitive space-charge-limited-current diodes such as 
CdS diodes should allow optical read-in operations which might be 
advantageous for certain applications such as a vidicon. 

II. TUNNEL SANDWICH DIODES 

For this nonlinear element, the circuit in Fig. 1 should be modified 
to include the shunt capacitance of the tunnel sandwich. Thus, at the 
instance of pulse application, the voltage divides between the two 
capacitors. The I-V relationship for Fowler-Nordheim type tunneling 
is 

/ = KVle- v ' /v \ (4) 

With the appropriate initial conditions, the stored charge Q(t) is given 

by 

Q(r) = c[v - aVVln {e aV ° /v + ^ r)] , (5) 



|*— v c — *\* v n >| i 



r 



V 



Fig. 1 — A capacitor being charged through a nonlinear resistor. 
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where « is defined as unity plus the ratio of the shunt capacitance of 
the tunnel sandwich, C„ to the charging capacitor, namely a = 1 + 
(C n /C). 
The discharge time constant t„ can also be shown to be 



(6) 



KV n {e 


ocf./a.K'-n 
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it - 


e aCV. /Q . 





_ (aCVo/Qo)<*-2) 



It is clear that charging time required for adequately large Q is very 
.short, allowing fast read-in operation. The decay time can be seen to 
be large for tunneling across well-known insulators such as Si0 2 and 
A1 2 3 . Therefore, the decay is not controlled by (6) but rather by the 
dielectric relaxation time of the insulators used for the entire assembly 
including the IGFET gate material. The dielectric relaxation time of 
the best inorganic insulators is of the order of one day at room tem- 
peratures. However, certain organic insulators are known to have 
theoretical dielectric relaxation times of many years. Performance of 
a memory cell incorporating a tunnel sandwich diode is described in 
more detail elsewhere. 5 

III. SCHOTTKY BARRIER DIODES 

For charging through a rectifier, Schottky barrier diodes are pre- 
ferred over pn junction diodes since Schottky barriers are majority 
carrier devices and hence fast recovery is achievable. I-V charac- 
teristics may be represented by 

/ = itfy - 1). (7) 

For charging, we may neglect the unity in the bracket in (7), and the 
stored charge can be shown to be 



Q(r) = C [ 7 _l ln (iL + ^)- 1 ] t 



(8) 



where 



C_ 

PL 



For decay, it is easy to show 



T 



. = ^ a (l-e" 1 ). (9) 
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Fig. 2 shows the stored charge Q computed from (8) as a function 
of pulse duration for several pulse amplitudes. The characteristic time 
constant t c is not much less than 1 sec for a typical configuration 
(C < 10 10 Fd, I s > 10" 12 amp). Therefore, it is seen that the stored 
charge is proportional to the pulse amplitude for sufficiently large V. 
This suggests that the device may be used as a multi-level storage 
unit. 

The combination of Schottky barrier diodes and the IGFET is 
shown in Fig. 3. A similar structure has been fabricated and tested. 
The holding time was of the order of 10 sec when the charging was 
done by 15 volts pulse in agreement with (9) since the IGFET gate 
capacitance was about 10 _1 - Fd and I s of the diode was 10~ 12 amp 
(measured at 10 volts reverse bias). The maximum pulse amplitude 
before the breakdown of the gate insulator was about 30 volts, allow- 
ing a longer holding time of about 30 seconds. The read-in time was 
less than 10 -7 second and the reverse breakdown of the diode was used 
to turn the IGFET off, which also took less than 10~ 7 second. 

A memory featuring nondestructive read-out, access times in the 
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Fig. 2 — Theoretical stored charge/storing capacitance (the floating potential) 
a.s a function of time for charging through a Schottky barrier diode. 
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~LT 



WRITE 



~\r 



READ 



(a) 



(b) 



Fig. 3 — Combination of the capacitor storage unit with a p-channel IGFET 
for read-out. (a) Series connection, read-in should be positive, (b) Parallel connec- 
tion, read-in should be negative. 

submicrosecond range, and holding times of many seconds should find 
many applications. An integrated structure incorporating Schottky bar- 
rier diodes and IGFETs is readily obtainable with modern solid-state 
technology. 
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